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ABSTEACT * - . v 

5ome results of a study of teacher preactive and 
interac<tive decision-making are presented. The paper focuses on 
teacher judgments and observations about the interactive behavior of 
other teachers. ' The teacher- judges viewed videotaped sequences of 
several lessons similar in content to lessons they themselves h^d 
just fini^hea teaching. .Patterns of teacher ob^ervatipn and 
preferences aaare reported and co?nparisons made to pupil obseryatiooas 
based on viewing the same videotaped lesson segments. The study 
indicates that there are statistically significant differences in the 
kinds of comments made by teachers- of high and low pupil gain/scoresr 
that teachers as a wtole seem to attend to relevant aspects of a 
given lesson and respond differently when observing different 
teaching procedures^ that individual teachers respond differentially 

""tiT'^'^is^iii^e^le'^ 

aspects of lessons than their teachers. (RC) 
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^ Teacluir ; Judgments and Pupil ' Observations : 

Beavity in the gye of the Beholder • - ^ 

.1 , ■ ' I ^ ; " ; ^ 5 • . . 

Greta Morine-Dershimer 

The data to be reported in this paper form one small part pf a \ 
larger study on Teacher aad Pupil Perceptions of Classroom Interaction^'*^ 
which was in turn a part of the larger Beginning Teacher Evaluation Study 
funded by the California State Commission on Xeaoher Preparation and 
Licensing, and' directed by David Berliner at the' Far' West Laboratory. 
The Beginning Teacher Evaluation was des^igned to .generate new and promising- 
variables for furtlier study of teaching effectiveness. The study of 
Teacher and Pupil Perceptions of Classroom Interaction wa^ built on the 
^ premise that the two major participants in classroom interaction - the 
teacher and the pupil - were an important source of information that had 
not been fully ''tapped. We elected, therefore, to gather data from those 
. participants iij order to identify new and promising variables related to 
Lortching effectiveness. The' final report identifies several such variables. 

Sub jects • , 

^The subjtict5; of the study were forty classroom teachers located in four 
dif ferent sect Lori« of California, There were twenby- second grade teachers 



iiiul twenty fifth [;rade teachers, who ^were selected from a group of two 

hundred volunteer teachers to represent a geographic range, to provide a 

d iriLribution in terms of pupil ability, to include a variety of teaching , • 

. styles, and most importantly , to provide difference in pupil^ain scores 

resulting from special two-week units of instruction in reading and mathematics. 

At each grade level our subjects included ten. teachers with high average pupil 
^^nln scores and tin .teachers with low average pupil gain scores on these ' 

instructional units. • • 

Within the I classroom of- each of the for ty . teacher subjectr^-i group of 

twelve pupils was identified^ These pupils formed a randomly^ selected 



*Greta Morine and Elizabeth Vallance, Teacher a ?^ d Pupil Perceptions of Class- 
room Interaction , Boj^inning Teacher Evc'^ -ation Study Technical Report 
//75-1.1-6, San Francisco, Far West Laboratory, 1975. 
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stratified sample of the total class-room, based on reading achievement ^ 
These twelve pupils formed a group to whom teachers taught two lessons f 
the teacher-pupil perceptions - one lesson in reading/ and one in math. 

A second pupil sample, which was a subset of the first, were pupils with 
whom small group interviews were held to gather 'information aboitl:- what . pupils 
observed teachers doing/ Briefly, a random selection wks made of pupils* • 
from participating classrooms within the Bay Area to set up six groups of ' 
four ^pils each. ' At second grade tAere was a group of four low achievers 
■in jg^ading, a' group of f(^iir- middle achievers , "and a group of- four higlKl_ 
achievers. This was repeated at fifth grade. Within each gloup of four ' 
there were pupils from different school systems and different classrooms. . . 
Procedure s ■ ^ ' * 

The two tasks within the study on which this paper v»ill concentrate are ' 
the Teacher Judgment Task and a corollary activity-^f pupils. that o^as part 
of the Pupil Concepts of Teaching Task:. These tasks^ere designed to ' 
an^er the following kinds oft questions : . » . 

.1. l^at types of thingsKlo teachers perceive when they observe other 
teachers engaged in classroom interactflon?,^ Wha.t judgments do they 
make about appropriateness 'of ' teaching moves in' various types of 
situations? On what do they- base th^se judgments?- ^an teachers 
be differentiated on this basis? If so, are these differences 
relet-ed-to--teacher- dlft ef encre¥"in i 1 gain "sc^or e s ? ~ 



2. Wliat kinds of teaching behavior are salifent to pupils? How dxj 
pupils interpret or conceptualize tMs behavior? Can pupils be 
, . differentiated on this /ta^is? If so, care thesi differences' 

related to pupil achievement and/or grade level? ' - 

Teachers were givea sample curriculum materials on a mathematical system 
called a lattice (s^ Appendix), and asked to plan a lesson that wduld be 
appropriate for their pupils. This lesson was observed apd "audiotaped . When 
the lesson was completed, the teacher was interviewed, and' the ' intervie^ 
consisted of three basic task^. - . 

., The Teacher 'Judgment Task provided an o|)portunity' for teachers to view 
other teachers teaching the same kind oKcontent that' they themselves had 
just taught. AVideX)tape was shown to the teachers, presenting segments of . 
five different lattice lessons, taught to small groups of _ pupils from- grades . 
two, four and five. ■ \ . 



K 

Variatioa in Lesso n s Viewed . Tlie lessoni> were varied in a number of 

different ways. In Les.son One a group of fifth graders ''invented'* their own 

problei»;s, .while the teacher wrote them on the board, organizing them, according 

to type of operation. The teacher accepted all pupil ideas- In Lesson Two 

a group of second graders also invented their own '^problems , but they them- 

selves drew arrows on a large chart ,in order to show their problems to the 

rest of the class. The teacher frequently redrew these arrows to make them 

larger or straighter. J n Lesson Three the teacher- u^ed an inductive discovery 

method to lead a group (»!' fourth grade students to realize that alternating 

arrows cancelled each other. A series of proble^us with alternating arrows 

were written on the board. When pupils madte an error the problem was "saved!' 

for them to answer later, and the teacher wrote the pupil's initial next to\ 

the problem as a reminder. In Lesson Four a second grade group used individual 

worksheets to draw arrows and find answers to problems -posed verbally by the- 

7 . . - • • • 

teacher. The teacher held a large paper arrow and demonstrated problems with 

this arrow and a number chart. No problems were written down, This\teacher - - 

used a great deal of positive reinforcement. When a pupil gave an incorrect 

iHiswer other pupils were invited'^to help in arriving at the correct answer. 

« 

fti Lesson Five ci fifth grade gtoup worked individually to place a geometric " 
I i>'ure bn a lattirt* according to a "code" (problem) that described the figure' 
CmikI its placement. When a pupil had difficulty the ^teacher gave additional 
.dxiiec4:-lons--«<>--thatr-^-he-i>up^i4r-coul-d-~sodv^^ alone . ^ T 

Contetit focus of the lessons varied as well. Lessons One and Three 
'^with fifth and tc^urth graders) dealt with the mathematical properties of 
\i\\K.\ lattice (viiat operations were possible; how reciprocal operations funcjtioned) 
Lessons Two and Four (wich second graders) focused on the numerical value of 
\\\v arrows = +10, 4/ -10). Lesson Five (with fifth graders) presented 
the lattice as an arranj^cment in space, and related it to geometry. 

— Teacher Interview s: . After each lesson sequence the interviewer stopped 
the videotape and asked the following questions: 

a. Wliat do you not ice about this teacher's general approach t;o the 
lattice lesson? 

b. Which specific: teaching procedures in this lesson seem particularly 
appropriate to you? ' 

c. Were thert! any specific teaching procedureis in this lesson that 
seemed inappropriate to, you? Why? , ' ^ 



After all sequences had been observed and conunented upon in this 
manner, the interviewer asked for comparisons of ^he lessons, with regard 
to whether some lessons seemed more interesting or more successful than th^ 
others; whether- there were any differences in the way the various teachers 
reacted to pupii errors; and whether there were any differences in the way 
the various teachers personalized the lesson or seemed. to deal with pupil 
feelings • Teacher respoiUies to these 'questions were audiotaped for later 
coding. 

* 

Pupil Interviews > At a later point iii'time the small groups oOour 
pupils each were shown two of these same five videotaped .lessons. The 
pupils were told: , . 

A few weeks ago yo^u had a lesson about a lat^iice. Do you remember 
k the lattice? Here is what it looked like. Here are some problems 

on the lattice. Do you remember how to do them? .... Good. You 
remembered a lot. .Well, we're going to look at some videotapes of 
teachers teaching a lesson on the lattice. First we'll look at a 
fourtli grade group,' then at a second grade group'. We'll just see 
part of each lesson. Afdet each lesson I'm going to ask you what 
you notifced that teacher 'doing. ^ 

Two 'Videotaped segments were played and ^ter each Segment pupils wpre 
asked what they had seen; and their comments were written dOwn on chart paper, 
iy-: they watched the videotapes pupils were very attentive tfa the lessons, 
calling out#-anfewers to the^ problems being, posed t o the videotaped class^^ a nd 
chocking the accuracy of ^ their answers. 

Analysis of Data . The responses of teachers and pupils to these tasks 
were coded through use of a basic category system that was developed to 
reflect the comments made (that Js, it was not a preconceived category system) 
and ''to compare responses across several tasks in the^ teacher-pupil perception 
study. Table 1 "shows "the five .major categories in this system, as well as 
the sub-categories, and notes the pattera. of responses from one task to 
another. lit additfon to^ this basic' category system a task-specific category 
system was developed to reflect particular 'aspects of the Teacher Judgment 
Task. The task-spepi^ic categories are presented in Chart 1. ^ ^ 

\ Tests of Interviewer InfJ.uence . Each teacher w^s interviewed twice by 
one intJ^rviewer . All interviewer^ had been trained together^ but since the 
interview schedule was rather openended and invited probing questions by the ' 
interviewer, a check was madje to determine whether the trjeiquency of teacher** 



response varied systematically according to int.'.rviewer . Each ^.nterviewer . 
worked with a different group ,of teachers. 'For the Teacher Judgment Task, 
the total number of types of judgments that teachers made' (categories 
mentioned) was compared by interviewer. Using a one-way analysis of Variance 
it was found that interviewers were not significantly different in the 
frequency of teacher responses they obtained for the various tasks.. 
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Table 1 



Basic Category Sys.tem 
.A Comparison of Category iise in Rfiation to Various Tasks 



General Approach 

A. Goals 

B. Instructional Strategy 

C. SeqtJence of' Procedures 

0. Teacher vs. Pupil Structure 

E. Teacher Activity 

F. PupiV Activity- ^ ^ 

G. Management/Control 

H. ' Seating Arrangement 

1. Size/ ComposUion of liroup " 
-O. Pupi 1 Outcomes ' •„ 

► Teacher Style . 



Teacher 
Judgment' 



Stimulated 
Recall 



Pupil Concepts^ 
of Teaching 



II. Materials - 



A. Preparation of Materials 

B. Type of Materials 

C. Teacher Use of Materials. 

D. Pupil Use of Materials 

III. Cognitive Aspects 



X 
X 
X 

^ > 

X 
X 
X 
X 
X 
X 
0 
X 



IV. Affective Aspects 

A. Treacher Enthusiasm 

B. Teacher Attitude Toward Pupils 

-C. Teacher Use of Positive Reinforcement 

D. Teacher Language i- 

E. PUpil Participation/Attention 
, Pupil 3ehavior 

G. Pupil Feelings 
H". Teacher Image 

V 

V. Physical Aspects 



ERLC 



A. 
B. 
C. 

I 



Pupil Comfort 
Teacher/ Pupil Movement 
Teacher/Pupil Proximity 
Visual/Auditory 
Classroom as a Whole 
Non-ver^;dl Conanunication 
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X 
. X 
0 
0 
X 
0 
0 
:0 



0 
X 
X 
X 

x 
b 



X 
X 
X 
X 
X 
X 
X 
X 
X 
0 
X 



0 
X 
X 
X 



0 
X 
X 
X 
X 
X 
X 
X 



X 
X 
0 

X 
0 
X 



0 
X 
0 
X 
X 
X 
X 
0 
X 
0 
0 



X 
^X 
-X 

X 



A. 


teacher Introduction ^ 


X 


X 


X 


' B. 


Teacher Directions 


0 


X 


X 


C. 


Tfcacher Questioning . 


X 


X 




D. 


Teacher Selection of Pupils for 








Discussion ' 




X 


X 


E. 


Teacher Wait for Response 


X 


X 


X 


— : 


~-Teac h er~Ex p1 wa 1 1 0 n 


X 


X 




G. • 


Teacher Response to Right/Wrong Answers 


5 1 ' 


X 


X 


• H. 


Teacher' Summary and Review of Lesson 


X ' 


. X 


^ I.. 


Vocabulciry 


X , 


X 


. X 


. J. 


Content Focus 


X 


X 


X 


K. 


Data (selection, organization, 










amount) 


X 


X 


X 




Pacing AT ime' 




X 


X 




Pupil Abili'ty 


X 


X 


X 


Pupil Background. Preparation, Needs 


0 


X. 


0 


0. 


Pupil Ideas 


0 


X 


. 0 


p. 


Pupil Learning 


0 




X 



X 
X 
X 
0 
X 
X 

r> 

0 



0 

X 
0 

X 

x * 
0 
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Task-Specific Catecjories 
Teacher Judpnient Task 
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Judgmental /Factual ^ ' * 
+ - judged appropriate 
— - judged inappropriate 
0 - neutral, or factaal observation 

."Interference" 
0 - inaccurate observation 

•J 

M - unusual interpretation 
? - uncertainty. 

Kiakes; Comparisons 
_lI_.^.--cora|iares_to..jDWja_t.fe.a.cbJng„ytu^^ 
T - cohipares to other taped teachers 



Unive r s a 1 y S i t u a 1 1 o n a 1 ' 

C - categorical rule proclaimed 

S - appropriateness is jitudtional 

I - indicates doesn't Ivave all 
necessary information to 
veri.fy or make ji|d=jment 

Curiosity 

^- wants to know more about a 
procedure 

N - notes it's a new idea 

U - unexpectedness - shows sufpris 
at an event , 

Considers Alternatives 

A - proposes alternative procedun 



R - revises earl ielr judgment 

fenoralizations' About Teachers - makes statements (without probing) that 
synthesize observations, noting similarities and differences among the group 
of teadxers on' videotape, or noting similartties and differences among teachers 

in general . , . n . ^ 

VJitholdinq Judgment - a score obtained by summing the neutral -or factual ob- 
servations (0), the comments indicating that appropriateness is situational (S] 
the indications that information "is lacking (I), and th^ instances of revising 
an earlier judgment (R). ^ 



Findings * ' - • ' x^, 

^ ■ * . J 

Briefly most of the findings dr^-the Teacher Judgment TasW are contained 
in Table 2. * There were several .statistically significant differev.ces 
between teachers of high and low. average pupiljgain scores. Fifth J^r^de 
teachers with high pupil gain scores noted more frequently that they 
needed more information in order to ma^e a judgment, and were less apt 
to make categorical as opposed to situational comments (a situational 
comment was one like, "well, that might work well with seco-t/d gr,ade children"). 
Second grade teachers wLfiU high pupil gain scorecwero ?iiore apt to note an^ 
idea or technique. that was new and interesting. The original expectation was 
that this might be a rough measure of curiosity, but as the table- indicates, 
there were very few instances of this"" type of response. Teachers at both 
grade levels 'with high pupil goin scores more frequently made comparisons 
between themselves and the teachers they viewed on videotape. The teachers 
were invited in the directions to make comparisons among ^the teachers on 
Videotape, but they tended instead to draw comparisons to themselves. 

Tables^ 3 and 4 show statistically significant diffe^rences arising 
from teachers' summary judgments. That is, at the end of viewing all five 
Josuons, teachers jfwere asked among other things which lessons were i^iost- 

igiltl^^^i a_te^Ki th r_c^ar d,.„tQ_J:.e,a,cM r^.espQnses_±o pupil errnrj^l Tun lessons 

stood, out here. In Lesson 2 a second grade teacher said "good" very frequently 
and very sweetly but corrected almost every pupil answier in one way ^r another^ 
cvru.to the point of redrawing their arrows for' them to make thetn straighter 
or darker. In Lesson 3 a fourth grade teacher said "Nq" wjhen a child wds 
wrong, then ^initialled tlie probleta to s4ve it for tha.t 'child, going on mean- 
while to other similar problems that would assist the child in solving his 
problem. Teachers with high pupil gain scores were more apt to judge Lesson *2 
negatively. Teachers wltli low pupil gain scores were more apt to judge 
Lesson 3 negatively.- It^was from this result that the subtitle for this«paper 
was dravin — "Beauty in the Eye of the Beholder" — for to this inveiiUigator 
Lesson 3 was indeed beautiful, but to eleveu cl^ssrpom teachers it was 
seriously lacking in some essential ingredient. --^^ 
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TABLE '2 

COilPARISON OF MEANS BY PUPIL GAIN SCORE 





Second. 


Grade 


Fifth Grade 


Combined 




High Pupil 
Gain . 
Scores 
(N=5>- 


Low Pupil 
Gain 
Scopes 
Ov-lO) 


High Pupil" 
-Gain 
Scores 

- (N=9) 


Low Pupil 
Gain 
Scores 
(N=9) 


High Pupil 
Gain 
Scores 
' (N=1A) 


Low' Pupi.' 

' Gain 
Scores 
(N=19) 


Noted Needed More 
Information Before 
Making Judgment 


2. A 


••^^ 

3.6 




. 


3.4 


2.7 


Noted An Idea or 
Technique that wa^ 
•^Jew and Interestirt^' 






.2 


.2 


.A 


.2 


Made Categorical vsj 
Situational Comments 


6.0 


J 

5.6 


' Ca.8 


• 


5.2 


• 6.2 

r~ 


Compared Taped 
Teachers to Self 


7.4 


3.9 


•. 5.0 


. ■ 3.6 




3j5 



* t-test of: significance, p<.05, df=14 (2nd grade) and 17 (5th grade) 

**..X=tasLo£.--sl&niticaace,--p.<-*-ia^„.df=J^^^ 



TABLE 3 

JUDGMENTS ON TEACHER RESPONSE TO PUPIL ERRORS; 
Lesson 2 - Teacher .Corrects Pupils iFrequently (2nd grade) 





Judged 


Didn't Judge 




Negatively 


Negatively 
» 


High Pupil 






Gain Seorefe 


7 

— ■■ 




Low Pupil . 






^Gaih Scores 


2 


17 



Fisher's Test of Exact Probability, p = .0191 



• TABLE 4 . » 

JUDGMENTS ON TEACHER RESPONSE TO PUPIL ERRORS: 
- Teacher Saves Problem for Pupil to Correct Own- Error (AtTi grade) 



1 . 

1 


' Judged 
Negatively 


. Didn't Judge- 
Negatively 


Hii^h. Pupil 
Gain Scores 


' s 

^ \ 


. . (. 

10 . - ^ 


Ldw ^Pupil 
Gain Scopes 


11 : 


8 ' 



= 3.05, p<'.10 



• Now, how do these teacher responses relate to pupil responses to two 
of the samej^ideotapecf Igssons? First, it*s important to note that the 
'papils were not' ^asked to make judgments, about appropriateness of teapher 
behavior. They wer"^ merely aske.d, "wha^t did you see^ the teacher doing?" 
The important fincjit^g for. purposes of this study was that pupils of all . 
grade levels and ability groups tended^ to comment most frequently <m' Teacher 
Responses to Right/Wrona Answers and on Data Selection X^^hat is, what kinds <^ 
of problems teachers gave? ^pupils to solve, and in what or^der the problems were 
presented) . ^ ,/he pattern of pupil responses was. clearly* no,t random, according 
to a Chi^^uare test of' significance, with p<.01. As regards the major 
categories, pupils focused on cognitive aspect^s of the lesson much more than ' 
anyi otlier aspect, and this was true for all* ability groups, though the middle 
achievers- tended to be the leaciers* here. 

lifiterestingly enough, pupils concentrated bn cognitive aspects of the 
lesson ,^yen more than teachers. Two-third's of pupil comments, as compared 
with l(e4s than, onavhalf of teacher comments, related to cognitive aspects • 
tli^./^bserved. Also of. interest was the fact that there were no statistically' 
su'.iiif icant differences between teachers of high and low pupil gain scores 
Willi regard to how frequently they referred to cognitive aspects of' the lessons 
I lu^y. observed . ' ' 

Vinl atlon in Teacher Response by Lesson 

The informiition prespfited here so far is all contained in the final 
report of the Study on Teacher and Pupil Perc^tions" of Classroom Interactions. 
lUil th^ paper provided an opportunity to do s(fme furthfer analysis of responses 
to- the Teacher Judgment Task. The intriguing question that led to this further 
analysis was whether tencliers responded very differently to the five individual 
le.SHons, for the teaching in these iessdns was quite varied. The differences 
in negative responses to Lessons 2 and 3, which wa'j mentioned earlier, suggested 
that other .differences ml^ht well exist. 'For this paper, the ared/ were 
selected where statistically significant differences were found betvyeen 
responses of teachers witli high and low pupil gain scores ,.j arid teacher response^ 
in these instances have been separated according to lessoh.,. No tests of 
significance have been made of this data, it 1^ presented here merely as 
descriptive of variations in teacher response. ^ . • ' 

Table 5 shows teiiclier fluencjy, or nuipber of coded"' comments about the- 
videotaped lessons. Actually there were no statistically sigiiificant differences 
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betweeh teachers of high and low pupil ^ain scores on the number of total ^ 
comment's made. . But fluency did differ from lesson to lesson, so it ll^s been * 
included here. Note .that the overall means resemble a bell curve as 
responses^move across lessons, with frequency of comments increasing fcarkedly , 
for the third lesson. This pattern is repeated for fifth grade teachers, for 
second grade teachers, and for teachers with high pupil gain scores, but, 
teachers with low pupil^^gdin scores have frequencies that look more/ like a 
flat plain interrupted %y a mountain peak. It is not clear Whether this 
difference in number of comments elicited by a lesson is a function of the 
lesson itself, or of teachers wapiing to the task, then tiring out. Hopefully i 
another tiiie the order i,n which teachers view the lessons can be varied in / 
order to answer that question. » 

-Table 6 shows the /genera'"!' focus that teacher/comments took in terms of 
the basic ciategory system. It is apparent that not all teachers had a focus 
in Lessons 1, 2, 4, and 5. That 4.s,, several teachiers 'in those lessons made 
one or two comments in each category,, but had no concentration of comments 
within a category area. Lesson *fi stands out because of the large number of 
teachers who had a' cognitive focus to their responses, ^j^ell as the fact 
that cme-^third of the teachers commented frequently on General Approach. ' . ^ 
(;oj',nitive focus was present to ?u lesser degree in Lessons 1, 2, and 5, but » 
*uot in Lesson 4. Lessons 2 arid 4 were the only ones in which teachers focused 
their comments on instructional materials. These were the two second grade- . ^ 
lessons. Again the general pattern of responses is repeated fairly consistently 
for each subgroup, fifth grade, second grade, and teachers with high and low 
pupil gain scor^es. WJiat this table strongly suggests is that teachers did 
respond differently to the different lesions ~ they focused on different 
aspects, they viewed the lessons differently, and they were alert to relevant' 
teacher behaviors in each lesson. . • . ^ • 

, '■ ' / . ■ " " ■ ' 

/ < • * 
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'■ TABLE 5' 
FLUENCY BY, LESSON 





1- 


2 


3 


4 


5 


Total 


Overall Results (N=33) 

i ^ . 

1 • Total Comments 
1 Means 
1 Range 


136 
4.12 
1-8 


170 

5.15 
.2-9 


264 
8.00 
3-15 ■ 


161 
4.88- 
2-8 


• 145 . 
,4.39 
1-11 


878 

26 ..67 
14-50 . 


Fifth Grade (N=18) 

Totals 

Hfeans ' 


77 
4.28 


92 
5.11 


136 • 
7.55 


81 

'«4.50 


' 79 

•V • 
4.39 


466 

"25.89 


• Second Grade (N=15) 
Totals 
Means 


59 ^ 
3.93 


78 
5.20 


' 128 
8.53 


80 
5.33 


66, 
4.40, 


412 
27.47 


1 IlLgh Pupil 

Ca In Score (N=1A) 

Totals 


58 
4.14 


76 
5.43 


124 
. 8 . 86 


76 

5.43 

c 


60 

" 4.29 


395 
28.21 


Low Pupil 

Cain Score (N=19) 

Totals . 

M<Nins 


78 . 
4.11 


94 
4.95 


140 
7.37 


85 
4.47' 


85 
' 4.47 


483 

, 25.42 



,^ ' TABLE 6 

NUMBER OF .TEACHERS SHOWING § 
GENERAL FOCUS BY LESSON 
(Category Emphasis) 





X 


9 






/ 


c 

5 


Total 


Overall Results (N=33) 
















General Approach 


4 


4 






0 


2 


21 


Materials 

■■J 


0 




0 


( 




n 


7 


Cognitive Aspects 


12 


11 


® 






11 


66 


Fifth .Grade' (N=18) 


- 














General Approach 


3 


2 


6 




0 


2 


13 


Materials 


0 


1 


0 




3 


0 


4 


Cognitive Aspects . 


6 


6 


15 




1 

■ — * 


6 


34 


Socoud Grade (N=15) 
















General Approach 


1 


2 


5 




0 


0 


8 


Materials 


0 


2 


0 




1 


0 


i 3' - 


Coj;nitive Aspects 


6 


5 


13 




3 


5 


32 


High Pupil 

Ga In Scores (N=14) 


, 












1 


GcMicral Approach 


0 


2 


5 

1 




0 


1 




Materials 


0 


1 


0 






0 






Cognitive Aspects 


6 


4 


14 ' 




2 


5 




31 1 

1 


T.ow. Pupil ' 

Gain Scores (N=19^) 








y 

/ 

/ 










General Approach 


A 


2 


6 




0. 


1 




fi 


Materials ^ 


0 


2 


, ° ■ - 

14 ^\ 




1 


0 






* 

Cognitive Aspects 


8 


7 




2 

t 


6 




" 1 ' 
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This becomes even more apparent from Table 7 v/hich presents the 
clustering ^of teacher co^micnts by subcategory. Only the subcategories ' ^ 
which received soecial attention from teachers' have been included here. 
A cluster (or an x on this chart) means- that over ' half of the teachers in 
a subgroup,- such as second grade teachers with high pupil gain scores, -< 
commented on .this particular subcategory in relation to a specif ic. lesson. 
The left hand columns here show shifting focus by lesson. Lesson 1 gathered 
comments about Instructional Strategy, ^nd nothing else. . Lesson 2 had 
single clusters for Instructional Strategy, Pupil Use of Materials, Teacher 
Response to Right/Wrong Answers, and' Content Focus, with a double cluster 
for Type of Materials, which resulted from teachers commentiug on the large 
chart the teacher had made. Again Lesson 3 stands out. (This Vas the 
inductive discovery lesson on alternating arrows, where the teacher saved 
the problem for the child who made an error). Here there are heavy clusters 
of comments on Instructional Strategy, Teacher Response to Right/Wrong ; 
Answers, Data Selection, and Pupil Learning. In Les^oi;i A, where pupils 
worked with individual lattices, the focus of comments was on Pupil Use of 
Mat:orlaLs. ' ^ ' /' / ' 

' When specific focus is examined by teacher gl^oJp in the right 'hand ^ - 
roliiinns, a fey; differences are apparent.. Fi^th grade teac)iers were more apt 

Cocup On Pupil Use of Materials and Teacher Response to Right/Wrong 
Ansv/ers. Second ^rade teachers were more apt to focus on Pupil Learning. . 
T<'achers with high pupil gain scores were more ap't fo focus on Teacher Response 
Lt» Right/Wrong Answers, on Data Selection, and ot? Pupil Learning. Teachers- 
with low pupil £ain scores were more apt to comment pn Content Focus of the 
Lcrsson. This latter difference is an .interesting one, and one 't-hdt should 
be woi^th pursuing further. ^ . , k„ ' 

Table 8 shows a breakdown of positive and negative judgments by Ipsson. 
Here the overall means show Lesson A receiving the most positive comments, 
while Lesson 3 receives the most negative comments'."-^ Across the five lessons 
teachers tended to make mqre positive than negative comments^ Th^s overall 
pattern is pretty much repeated by fifth grade teachers and by* teachers with 
low pupil gain scores, but the/ other two groups break the mold to some degree. 
Second grade teachers are somewhat more negative about both Lessons 2' and 3 
.than are the fifth grade teachers. Teachers with high pupil gain scores are 
more negative about Lesson 2 and more positive about Lesson 3 tfian are teachers 
with low^pupil gairTscores. Again there i*g an indication that teachers as a . | 
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TABLE 7 
» SPECIFIC FOCUS 
CLUSTERING OF CATEGORIES 



I Focus By Lesson 



1 ' 2 



Specific Categories 



Focus By Group 

Fifth Second High 
tJrade Grade Gain 



Low 
Gain 





3 


XX 


XX 


XX 


xxx 


X 


\ 


XX 


XX 


XXX 


XXX 


X 


X 


xxx 


XX 


xxxx 


■ XX 


X 


XXX 


xxxx 


X 


X 




xxxx 


XX 



XX 



XX : 

XX ; 



XX 



X 
X 

XX 



xv. 



XXX 

xxx 

XXXX 



I 



xxxxx 

X ; 

• I 

xxxxx i 1 



Generar Approach 

Instructional 
Strategy 

Materials 



XX 
XX 



X 
X 

XX 



Preparation of . 
Type of / 

Pupil Use of 
Cognitive Aspects 



X 
XX 

XXX 



XX 
}fXX 



X 

xxx 



T. Directions 
T.' Explanation 

T. Response to 
R/W 

Content Focus 

Data Selection 
Pac ing /Time 

Pupil Learning 

Affective Aspects 
Pupil Participation 



XXX 

•XXXX 
XXX 

XX 



X 



' X 

X 
XX 

XX 
X 

' - ? 

xxx 

' X 

xxxxx 
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TABLE 8 
POSITIVE-NEGATIVE JUDGMENTS 
MEAN stoRES BY LESSON 



t 


1 


2 


3 


4 


5 . 


Total 


•Overall Results (N=33) 














Positive 
Negative 
Neutral 


\.88 . 

1.00 : 

1.27 


1.9A 
2.03 . 
1.18 


2.61 . 
(3.85) • 
1758 


(33). 

.76 

-88/ 


2.76 
.76^ 

\79 


12.42 
8.40. 
. 5.70 


Fifth'Cr^de (N=18) 














Positive • 
Negative 
. Neutral 


,1.94 
1.22 
1.17 


2.00 
1.72 
1.39 • 


2.61 
3.33 
1.61 


\3.33 ■ 

'Vso 


2.61 
.61 
1.00 


1-2.56 
7.39 
5.83 


Second Grade (N=15) 
Positive 
Negative 
Mtiiitral • 


1.80 
.73 
l.AO 


1.87 
(2^ 
793 


2.60 

0 

1.53 


-f. 

'3.13 
1.07 

1.13. : 


2.93 
.93 . 

V .53 • " 


12.33 ^ 
.9.60 
5.53. 


l!ij;h Gains (N=1A) 














Positive ^ 
Negative 
Ni'utral . 

1 ^ ^ 


1.71 , 
1.21 • 
1.29 ' 


1;71 

0 

1.07 , 


3.86 
1.7.9 


3.21 
1.00 
1.21 


2.79 
.71 


12.64 
9.50_^ 
6.07 ■ 


•Low Gains ' (N=19) ^ 

Poiiit^ve 
j Negative 

Neutrjal 
I . . - 


2.00 . 

1.2'6 

\ 


2.11 
1.58 
1.26 


\ 

3.84 
1.42 


4 

3.26 
.59 . 
.63 


2.74- 
.84 

i 


12.79 
.7.58 ^ 
5.42 




whole responded differently to the 'teaching procedures they observed in the 

■ -tw " ^ 

various lessons, and that individual teachers .responded differently from 

each other. ^ ^ • 

Table 9 shows the specific focus of teachers ' positive and negative ' 
judgments. Note that in Lesson 3, whichils the only lesson to draw clusters 
Of negative comments, the categories of Teacher Response to Right/Wrong 
Answers and Data Selection collect clusters of both positive and negative 
responses,. The reader may recall that these two categories .were also the 
ones that pupils focused on in viewing^this videotape — but p6pil comments 
were generally neutral. Again we have an indication that both pupils and 
teachers perceive relevant aspects of a given lesson, but may respond 
differently in judjg^^ng the appropriateness of the teaching behavior they • 
observe. ^ ^ 

Table 10 indicates the number of teacher comments to the effect that 
appropriateness of behavior is situational , or that more information is needed 
to make a judgment of appropriateness. It is apparent from the small means 
wlu?n these are broken down by lesson, that these kinds of comments were no't . 
particularly freq^ient. Lesson 3 gathers 'the largest niimber of informational 
comments. One strong .impression resulting from this lesson by lesson analysis ' 
miv.ht well be that Inductive discovery techniques like those used in Lesson 3 * 
niu? not weir understood by the teachers who were interviewed. -It's encouraging 
that some of them were aware that they needed mpre information about this* 
strategy. One particularly interesting Item dLn this table is, that fifth grad0 
toiicliers made more situational comments about Lessons 2 and 4, which Yi^re * 
the -second grade lessons, while second grade teachers made the most ^ituational- 
comments about Lessons 1 and 3, which were fifth\and fourth grade' lessonsat ^ ' 
Thai is, teachers were apparently willing to say^, "well, J:hat mav work in that 
situation" when they were talking about a grade level, other than their own, 
but not so willing to make such comments about teach/efs on their ox^ grade level 

Table 11 shows teacher cgmparispns 'lesson by lesson. It seems clear that 
teachers a^a whole were, mor'e apt • to draw comparisons between themselves and 
a given videotaped teacher than they were to compare one videotaped , teacher to 
another. * Of course in Lesson 1, comparisons to self Vere tfhe c)^ly^kind to be 
made, s^nce only one videotaped teacherx had been seen. It is also clear that 
self-comparative statemends aropi)ed off slowly, lesson iJy lesson. Could this' 
mean perhaps 'that as teachers saw^ore examples 6f varied ways of approaching 
the lessons, ^they felt les;s defensive about the "procedure they themselves had 
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TABLE 9' 
SPECIFIC FOCUS OF JUDGMENTS 



Positive Judgments 

Focus b y Lesso n " ' .Lq£us Gl£UE • .J 













I 


^if th 


Second 


Hign 


Low 


1 


2 


3 


4 


5 ! 


Specific Categories C 


Srade 


Grade 


Gain 


Gain 






















X 




• 






Instructional 


X 


XX- 


XX 


X 


XX 




a 






Strategy 
Materials 










X 










Type of 




X 


X 






^ . 




XXX 


XX 

l1 

i 


Pupil Use of 
Cognitive Aspects 


XX XX 


X 


XX 


XXX 






XX 
XX 






T J) a c* T\r\n c o fT\ T? /l/J 


XX 


XX 


X 


X 


1 




XX . 






Da f A ^fyLec tion 
Affective 


X 


X 


X 


X 






X 






Pupil Participation 




X 


X 














Negative Judgments 










Focus by Lesson 






Focus by Group 




7 












Fifth ^ 


■I Second 


High 


Low 




2 


3 




5 




Gr-^de 


Grade 


Gain 


Gain 












Cognitive Aspects 












f 


X 
XX 

X 

X ■ 






T. Response to R/.W 
Data Selection 
Pupil Learning 


XX 
X 


- X 
X 


X 
X 


XX 
X 



21 

* • t . - • 

o . 

ERIC " 



T£\BLE_10 . 

SITUATIONAL- INFORMATION COMMENTS 
MEAN SCORES BY LESSON 



1 


2 


3 


4 


s 


Total 


Overall Results (N^ 


33) 












Situational \ 


.52 


.58 


.61 


55 


. -JO 




Inf orma ti^Mial 

■ \ 


.42 


.61 




.52 


•55 " . 


3.00 ' 


Fifth Grade (N=18) 




— , 










Situational 


.11 










Informational 


.33 


.61 


.72 


.39 




;2.6i 


Second Grade (N=15) 






i 








Si tuat ional 




.27 




.40 


40 


3 0*7 


Informational 


.53 


1 

.53 

0 




.67 


.27 


3.20 


IIIt;h Gains (N=14) 




— ' 










S i Miational 


.43 




.71 


@ 


.29 


3.21 


1 

1 Informational 


.50 


.71 


.93 

t. 


.64 


.57 


3.07 


1 

Low Gains (N=19) 














Situational 


.58 


.37 


.53 


.26 


.37 


2.21 


Informational 


.37 


.53 


.89 


..42 


.53 


2.74 • 



22 



TABLE IL 

COMPARISONS TO SELF AND TAPED TEACHERS 
MEAN -SCORES BY LESSON 





1 


, 2 


3 


4' 


, 5 


Total 


Overall Results (N=33) _ 












Self 
Tapes 


(l^ 
.00 


1.15 
.73 


1.09 
.'76 


.55 
.67 


.55 
'.39 


4.64' 
2.58 


Fifth Grade (N=18) 
Self 
Tapes 


.V.28 
.00 


.78 
.94 


(iTzs) • 

.78 


t . 

.33 
.67 


-.61 
.50 ' 


4.28 * 
2.89 


'Se\:ond Grade (N=15) 
1 Self 
i Tapes 

i 


1.33 
.00 


^ — i 

(i?6^ 
. .47 


I— 

.87 
.73 


@ 

'.67 


.47 
.11 


5.07 
2.20 


; lliKh Gains (N=14) 
Self 
Tapes 


1.50 
.00 


1.43 
.93 


.71 


. .79 
.93. 


.79 ; 
.38 . 


6.29 
2.93 


: l.uw Gains (N=19) 
1 Self 
Tapes 


1.16 
.00 


.95 
.53 


.58 
.79 


.37 
.47 


■ .37 
.^2 


3.42 
2.32 



selected, and thus had less need to compare themselves to the videotape? 

' • *• 

ThUs would be another interesting question to pursue further. 

Summary - ^ 

To summarize briefly, the study of Teacher Judgments, which was* 
embedded in the larger study of Teacher and Pupil Perceptions of Class- 
room Interaction indicates that there are statistically significant 
differences in the kind.s* of comments made by teachers of high and low 
pupil gain scores, that teachers as. a whole seem to attend to relevant, 
aspects a given lesson arid. respond differently when observing different 
teaching procedures, that individual teachers respond differentially to the 
same lesson, ^ndthat pbpils are attentive to different aspects^of lessons 
than their teacheors. What is ''beautiful" to one teacher 'may not be 
beautiful to another, -^o ,this researcher those differences in perception 
are very interesting. Hopefully, with further study we can learn enough 
to make that information useful for teacher training, as well as interesting 
for educational researr.h. 



APPENDIX 

^Instructions, to Teachers: " 
Using the Lattice (Mathematical Operations) 



In this lesson you will be. working with a simple/ mathematica,l system . 
known ias a lattice. Jhe lattice consists of an arrangement of whole numbers 
in a way that'can be used to perform (and demonstrate) many different kindS' 
of mathe'matical. operations. A lattice of the^numbers 0-99. arrangedin 
tens, is shown below. ^ v 



90 91 92 93 94 95 96 • 97- - 98 ' 99 ; 

80 81 82 83 84 85 86 ' 87 ,88 89 

70 71 72 73 74 75 76, 77 7^ 79 

60 61. 62 63 64 65 66 67 68 69 

50 - 51 52 53 54^^55 56 57 '58 59 

40 41 42 ,43 44s 45 46 47 48 49 

30 31 32 33 34 35 36 37 38 ,39 

''20 21 22 23" 24- 25 26 7.7 28 2? 

10 11 12 13 14 15. 16 17 18 >9 



<5 



1 2 3 4 ' 



8 9 



The lattice n,ay include more or fewSr nurters than the one shown here, and 
can be arranged W fives or in other groups as well. ,Generally we have found 
the tens grouping to be the clearest and easiest to use. particularly for 
teachers and pupils not .familiar with it,. An" array of 0-49 seems .to be the 
smallest-Sized lattice that still alli«s enough leeway for experimenting 
Kith very different kinds of problems. , . , ' ■ 

The-ftttice is used ^o demonstrate the relationships between outers 
and the operations perfon^d on them by .sing arrows' which trace a path of 
moves from on»nu,^er to, another. Thus. In the partial lattice bel<« 



30 3r 32.^.33 - 34 
20. 21 22 23 24 



10~*11 J2 13 14 

a IK 
0 1 2 3 4 



the solid arrows- in group a^ show the move .from 0 to 10 and from there to 11. 
The dotted arrow shows the move directly from 0- to 11. An unlimited number 
of arrows can connect numbers in more and less cojnplicated paths. The im- 
portant characteristics of the arrows are that a sideways move (right or 
left one space) produces a change o'f plus or minus 1, and a- vertical move . 
(up or da/vn) produces a change of plus or minus 10. Diagonal arrows (in 
any of four directions: see group b^ in the small lattice above) pr/jduce a 
Change of plus or minus 11 (10 ^= 21; 21 ^ = 10) or plus or minus 9 
(10"i>/ = 1 ; 1 ^ = 10). Opposite arrows "cancel" each other (10 = 10) 

Lattice "problems" are a'standard way of explaining how the lattice 
works, by allov/ing pupils to work thrpucK, the operations. There are several 
kinds of iktice problems'. The basic four are illustrated bllow. 

1. One-arrow problems: 

*14-^ = (15) . \ ■' ... 

20 I .= (10) 
3 ^ = (14) 

' ■ ' ■ 

2. Two-arrow problems: . 
3->-> = (5) 

3 f - (14 4 , 
. ' ; 16 = (16) : 

3. Many-arrow problems: 

3 f — f = (27) 

19 > = 29 

31 f.~»J,f-^;— > (34), 

* 

4. "Missingrarrow" problems: 
a-)l5 =26 
b)45 =15 ' 

. c) 6 =8 ' 

Some possible answers (there are many) to #4: 

a) l5 --^ = '26; 15 f =26; IStfi =26 

b) 46*s'U = 15; ' 46 |t-U =15; 46^^*^=15 

. c) 6'.W-^ = 8; . 6^s*. - = 8; 6 f-*-^ |> = e 
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• These basic problen; fonnats all o\/ for a wide range of mathematical , 
principles and operations to be demonstrated and discovered. Possible ob- 
jectives of a first' lesson on the' lattice might include: 

1. Pupils will learn to solve one- arrow (two-arrow) problems. 

2. Pupils will discover al3 eight .of the one-arrow .operations 

I* 

3. ..Pupils will learn th^t 14 f =14.^ (transi- ; ; 

tiVity). ' ' ' ,r ' • 

4. Pupils will Iparn that opposite arrows cancel each 
other: 41 = 41. ^ .. ' 

5 Pupils will learn that there are many (an infinite ■ 

' number of) ways to get from one number to another. ^ 

More complex principles can also be.used as the basi5 of lesson^ objectives . 
depending on the teacher's familiarity with the lattice and- on ^hi Idren^'s " 
success with simpler operations 01^ it. These include; / 

6 Multiple cancelling , ... . 
. - a the princijxle that a series of alternating arrows 

■ cancel each other when there are an even number 

of them (3 r i fit I' = 3) ^ - ' 

(and do move .one step) when there is. an odd number - 

of ar?^ws {Snn P i> f = 13). . . , . 

b. the principle that the opposi.ng arrows need not 
be sequenced in pairs in order .to cancel each 
other, (for example, 32 f — I - 

7 The' system of the lattice (being able to^roject to _ 
points above the top line of numbers and. identify what 
those numbers would be)". . . 

8. Identificationjf numerical^ meaning of thj ^i^rf^sj^ ^ ^^^^ 
'y I .11; \ = +9; \ = -9* 

You may want to practice making up problems with the lattice and . 
. familiarize yourself with the operations that the various arrow patterns 
describe before trying td teach a lesson. The lattice is not complicated 
and should be fairly easy to use. Your task in this lesson is to teach _ 
.^our pupils something about the lattice - we are interested in how dii^ferent 
>teachers use this material in teaching, so what you teacK. and how you organi-ze 
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the lesSon are- completely up to you. Feel free to experiment; 

Do not feel that you must try- to teach higher-order^princlples, or 
that" you must teach as much as possible about the .lattice. You may want . 
to cl3»,so if* you feel your pupils can handle it (and you may decide in the 
middle of the- lesson to go'.: further than you had planned), but different 
approaches to the lattice are appropriate for different grajdes. and abi li ty 
levels. Use your judgment — o.Oo(ur pupils' back-ground ancf of/your under- 
standing of the lattice -- in de(/iding\what and hbw to teach. 
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